Towards 5G: A reinforcement learning-based scheduling solution for data traffic management

Dominated by delay-sensitive and massive data applications, radio resource management in 5G access networks is expected to satisfy very stringent delay and packet loss requirements. In this context, the packet scheduler plays a central role by allocating user data packets in the frequency domain at each predefined time interval. Standard scheduling rules are known limited in satisfying higher quality of service (QoS) demands when facing unpredictable network conditions and dynamic traffic circumstances. This paper proposes an innovative scheduling framework able to select different scheduling rules according to instantaneous scheduler states in order to minimize the packet delays and packet drop rates for strict QoS requirements applications. To deal with real-time scheduling, the reinforcement learning (RL) principles are used to map the scheduling rules to each state and to learn when to apply each. Additionally, neural networks are used as function approximation to cope with the RL complexity and very large representations of the scheduler state space. Simulation results demonstrate that the proposed framework outperforms the conventional scheduling strategies in terms of delay and packet drop rate requirements

A comparison of reinforcement learning algorithms in fairness-oriented OFDMA schedulers

Due to large-scale control problems in 5G access networks, the complexity of radioresource management is expected to increase significantly. Reinforcement learning is seen as apromising solution that can enable intelligent decision-making and reduce the complexity of differentoptimization problems for radio resource management. The packet scheduler is an importantentity of radio resource management that allocates users’ data packets in the frequency domainaccording to the implemented scheduling rule. In this context, by making use of reinforcementlearning, we could actually determine, in each state, the most suitable scheduling rule to be employedthat could improve the quality of service provisioning. In this paper, we propose a reinforcementlearning-based framework to solve scheduling problems with the main focus on meeting the userfairness requirements. This framework makes use of feed forward neural networks to map momentarystates to proper parameterization decisions for the proportional fair scheduler. The simulation resultsshow that our reinforcement learning framework outperforms the conventional adaptive schedulersoriented on fairness objective. Discussions are also raised to determine the best reinforcement learningalgorithm to be implemented in the proposed framework based on various scheduler settings

Enhancing user fairness in OFDMA radio access networks through machine learning

The problem of radio resource scheduling subject to fairness satisfaction is very challenging even in future radio access networks. Standard fairness criteria aim to find the best trade-off between overall throughput maximization and user fairness satisfaction under various types of network conditions. However, at the Radio Resource Management (RRM) level, the existing schedulers are rather static being unable to react according to the momentary networking conditions so that the user fairness measure is maximized all time. This paper proposes a dynamic scheduler framework able to parameterize the proportional fair scheduling rule at each Transmission Time Interval (TTI) to improve the user fairness. To deal with the framework complexity, the parameterization decisions are approximated by using the neural networks as non-linear functions. The actor-critic Reinforcement Learning (RL) algorithm is used to learn the best set of non-linear functions that approximate the best fairness parameters to be applied in each momentary state. Simulations results reveal that the proposed framework outperforms the existing fairness adaptation techniques as well as other types of RL-based schedulers

Hepatitis C virus cell-cell transmission and resistance to direct-acting antiviral agents

Hepatitis C virus (HCV) is transmitted between hepatocytes via classical cell entry but also uses direct cell-cell transfer to infect neighboring hepatocytes. Viral cell-cell transmission has been shown to play an important role in viral persistence allowing evasion from neutralizing antibodies. In contrast, the role of HCV cell-cell transmission for antiviral resistance is unknown. Aiming to address this question we investigated the phenotype of HCV strains exhibiting resistance to direct-acting antivirals (DAAs) in state-of-the-art model systems for cell-cell transmission and spread. Using HCV genotype 2 as a model virus, we show that cell-cell transmission is the main route of viral spread of DAA-resistant HCV. Cell-cell transmission of DAA-resistant viruses results in viral persistence and thus hampers viral eradication. We also show that blocking cell-cell transmission using host-targeting entry inhibitors (HTEIs) was highly effective in inhibiting viral dissemination of resistant genotype 2 viruses. Combining HTEIs with DAAs prevented antiviral resistance and led to rapid elimination of the virus in cell culture model. In conclusion, our work provides evidence that cell-cell transmission plays an important role in dissemination and maintenance of resistant variants in cell culture models. Blocking virus cell-cell transmission prevents emergence of drug resistance in persistent viral infection including resistance to HCV DAAs

Bose-Einstein correlations of same-sign charged pions in the forward region in pp collisions at √s=7 TeV

Bose-Einstein correlations of same-sign charged pions, produced in protonproton collisions at a 7 TeV centre-of-mass energy, are studied using a data sample collected by the LHCb experiment. The signature for Bose-Einstein correlations is observed in the form of an enhancement of pairs of like-sign charged pions with small four-momentum difference squared. The charged-particle multiplicity dependence of the Bose-Einstein correlation parameters describing the correlation strength and the size of the emitting source is investigated, determining both the correlation radius and the chaoticity parameter. The measured correlation radius is found to increase as a function of increasing charged-particle multiplicity, while the chaoticity parameter is seen to decreas

Observation of J/ψpJ/\psi p resonances consistent with pentaquark states in Λb0→J/ψK−p{\Lambda_b^0\to J/\psi K^-p} decays

Observations of exotic structures in the $J/\psi p$ channel, that we refer to as pentaquark-charmonium states, in $\Lambda_b^0\to J/\psi K^- p$ decays are presented. The data sample corresponds to an integrated luminosity of 3/fb acquired with the LHCb detector from 7 and 8 TeV pp collisions. An amplitude analysis is performed on the three-body final-state that reproduces the two-body mass and angular distributions. To obtain a satisfactory fit of the structures seen in the $J/\psi p$ mass spectrum, it is necessary to include two Breit-Wigner amplitudes that each describe a resonant state. The significance of each of these resonances is more than 9 standard deviations. One has a mass of $4380\pm 8\pm 29$ MeV and a width of $205\pm 18\pm 86$ MeV, while the second is narrower, with a mass of $4449.8\pm 1.7\pm 2.5$ MeV and a width of $39\pm 5\pm 19$ MeV. The preferred $J^P$ assignments are of opposite parity, with one state having spin 3/2 and the other 5/2.Comment: 48 pages, 18 figures including the supplementary material, v2 after referee's comments, now 19 figure

Observation of an Excited Bc+ State

Using pp collision data corresponding to an integrated luminosity of 8.5 fb-1 recorded by the LHCb experiment at center-of-mass energies of s=7, 8, and 13 TeV, the observation of an excited Bc+ state in the Bc+π+π- invariant-mass spectrum is reported. The observed peak has a mass of 6841.2±0.6(stat)±0.1(syst)±0.8(Bc+) MeV/c2, where the last uncertainty is due to the limited knowledge of the Bc+ mass. It is consistent with expectations of the Bc∗(2S31)+ state reconstructed without the low-energy photon from the Bc∗(1S31)+→Bc+γ decay following Bc∗(2S31)+→Bc∗(1S31)+π+π-. A second state is seen with a global (local) statistical significance of 2.2σ (3.2σ) and a mass of 6872.1±1.3(stat)±0.1(syst)±0.8(Bc+) MeV/c2, and is consistent with the Bc(2S10)+ state. These mass measurements are the most precise to date

Study of B−→DK−π+π−B^{-}\to DK^-\pi^+\pi^- and B−→Dπ−π+π−B^-\to D\pi^-\pi^+\pi^- decays and determination of the CKM angle γ\gamma

We report a study of the suppressed $B^-\to DK^-\pi^+\pi^-$ and favored $B^-\to D\pi^-\pi^+\pi^-$ decays, where the neutral $D$ meson is detected through its decays to the $K^{\mp}\pi^{\pm}$ and CP-even $K^+K^-$ and $\pi^+\pi^-$ final states. The measurement is carried out using a proton-proton collision data sample collected by the LHCb experiment, corresponding to an integrated luminosity of 3.0~fb$^{-1}$. We observe the first significant signals in the CP-even final states of the $D$ meson for both the suppressed $B^-\to DK^-\pi^+\pi^-$ and favored $B^-\to D\pi^-\pi^+\pi^-$ modes, as well as in the doubly Cabibbo-suppressed $D\to K^+\pi^-$ final state of the $B^-\to D\pi^-\pi^+\pi^-$ decay. Evidence for the ADS suppressed decay $B^{-}\to DK^-\pi^+\pi^-$, with $D\to K^+\pi^-$, is also presented. From the observed yields in the $B^-\to DK^-\pi^+\pi^-$, $B^-\to D\pi^-\pi^+\pi^-$ and their charge conjugate decay modes, we measure the value of the weak phase to be $\gamma=(74^{+20}_{-19})^{\rm o}$. This is one of the most precise single-measurement determinations of $\gamma$ to date.Comment: 22 pages, 9 figures; All figures and tables, along with any supplementary material and additional information, are available at https://lhcbproject.web.cern.ch/lhcbproject/Publications/LHCbProjectPublic/LHCb-PAPER-2015-020.htm

Search for the rare decays B0→J/ψγB^{0}\to J/\psi \gamma and Bs0→J/ψγB^{0}_{s} \to J/\psi \gamma

A search for the rare decay of a $B^{0}$ or $B^{0}_{s}$ meson into the final state $J/\psi\gamma$ is performed, using data collected by the LHCb experiment in $pp$ collisions at $\sqrt{s}=7$ and $8$ TeV, corresponding to an integrated luminosity of 3 fb$^{-1}$. The observed number of signal candidates is consistent with a background-only hypothesis. Branching fraction values larger than $1.7\times 10^{-6}$ for the $B^{0}\to J/\psi\gamma$ decay mode are excluded at 90% confidence level. For the $B^{0}_{s}\to J/\psi\gamma$ decay mode, branching fraction values larger than $7.4\times 10^{-6}$ are excluded at 90% confidence level, this is the first branching fraction limit for this decay.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://lhcbproject.web.cern.ch/lhcbproject/Publications/LHCbProjectPublic/LHCb-PAPER-2015-044.htm

Measurement of the Bs0→J/ψηB_{s}^{0} \rightarrow J/\psi \eta lifetime

Using a data set corresponding to an integrated luminosity of $3 fb^{-1}$, collected by the LHCb experiment in $pp$ collisions at centre-of-mass energies of 7 and 8 TeV, the effective lifetime in the $B^0_s \rightarrow J/\psi \eta$ decay mode, $\tau_{\textrm{eff}}$, is measured to be $\tau_{\textrm{eff}} = 1.479 \pm 0.034~\textrm{(stat)} \pm 0.011 ~\textrm{(syst)}$ ps. Assuming $CP$ conservation, $\tau_{\textrm{eff}}$ corresponds to the lifetime of the light $B_s^0$ mass eigenstate. This is the first measurement of the effective lifetime in this decay mode.Comment: All figures and tables, along with any supplementary material and additional information, are available at https://lhcbproject.web.cern.ch/lhcbproject/Publications/LHCbProjectPublic/LHCb-PAPER-2016-017.htm